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ABSTRACT 



In 1990, the National Assessment of Educational Progress 
(NAEP) included a Trial State Assessment (TSA) ; for the first time in NAEP ' s 
history, voluntary state-by-state assessments were made. In 1994, TSA was 
expanded to include non-public school students. The 1994 reading assessment 
considered students' proficiency in situations that involved reading 
different kinds of materials for different purposes. The fourth-grade 
assessment measured two global purposes for reading- -reading for literary 
experience and reading to gain information. In Indiana, 2,655 students in 100 
public schools and 219 students in 10 non-public schools were assessed. This 
report describes the reading proficiency of Indiana fourth-graders and 
compares their overall performance to students in the Central region of the 
United States and the nation (using data from the NAEP national assessments) . 
The distribution of reading results and reading achievement level results are 
provided for subpopulations of students (race/ethnicity, type of location, 
parents, educational level, and gender). Reading proficiency and achievement 
of non-public school students are separately reported and compared to public 
school students. To provide a context for the assessment data, participating 
public school students, their reading teachers, and principals completed 
questionnaires which focused on: policies and practices related to reading 
(time for instructional activities and instructional resources for reading) ; 
delivery of reading instruction (instructional materials and activities, 
workbooks/ worksheets/writing, discussion and group activities, time to read, 
reading and use of libraries, assessing progress in reading) ; reading 
instructors (preparation, experience and professional development); students' 
home support for literacy (reading outside of school and in the home and 
hours of television watched per day) . The average reading proficiency of 
fourth-grade public school students in Indiana on the NAEP reading scale was 
220 compared to 212 nationwide. (SR) 
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What ns The Nation's Report Card? 



THE NATION’S REPORT CARD, the National Assessment of Educational Progress (NAEP), is the only nationally representative and continuing 
assessment of what America’s students know and can do in various subject areas. Since 1969, assessments have been conducted periodically in 
reading, mathematics, science, writing, history/geography, and other fields. By making objective information on student performance available to 
policymakers at the national, state, and local levels, NAEP is an integral part of our nation’s evaluation of the condition and progress of education. 
Only information related to academic achievement is collected under this program. NAEP guarantees the privacy of individual students and their 
families. 

NAEP is a congressionally mandated project of the National Center for Education Statistics, the U.S. Department of Education. The 
Commissioner of Education Statistics is responsible, by law, for carrying out the NAEP project through competitive awards to qualified organiza- 
tions. NAEP reports directly to the Commissioner, who is also responsible for providing continuing reviews, including validation studies and 
solicitation of public comment, on NAEP’s conduct and usefulness. 

In 1988, Congress established the National Assessment Governing Board (NAGB) to formulate policy guidelines for NAEP. The Board is 
responsible for selecting the subject areas to be assessed from among those included in the National Education Goals; for setting appropriate student 
performance levels; for developing assessment objectives and test specifications through a national consensus approach; for designing the 
assessment methodology; for developing guidelines for reporting and disseminating NAEP results; for developing standards and procedures for 
interstate, regional, and national comparisons; for determining the appropriateness of test items and ensuring they are free from bias; and for taking 
actions to improve the form and use of the National Assessment. 
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In 1988, Congress passed legislation for the National Assessment of Educational 
Progress (NAEP) that continued its primary mission of providing dependable and 
comprehensive information about educational progress in the United States. In addition, 
for the first time in the project’s history, the legislation also included a provision 
authorizing voluntary state-by-state assessments on a trial basis. 

As a result of the legislation, the 1990 NAEP program included a Trial State 
Assessment Program in which public-school students in 37 states, the District of 
Columbia, and two territories were assessed in eighth-grade mathematics. 1 The 1992 
NAEP program included an expanded Trial State Assessment Program in fourth-grade 
reading and fourth- and eighth-grade mathematics, with public-school students assessed 
in 41 states, the District of Columbia, and two territories. 2 

The continuation of NAEP’s Trial State Assessment Program in 1994 was 
authorized by additional legislation that enlarged the state-by-state assessment to include 
non-public school students. In addition to the state assessment program in reading at 
grade 4, the 1994 NAEP involved national assessments of reading, world geography, 
and U.S. history at grades 4, 8, and 12. The 1994 Trial State Assessment Program was 
conducted in February 1994 with 44 participants (41 states, the District of Columbia, 
Guam, and the Department of Defense Education Activity [DoDEA] Overseas Schools). 

This computer-generated report describes the reading proficiency of fourth-grade 
students in Indiana, the Central region, and the nation. The distribution of reading 
proficiency results and reading achievement level results are provided for groups of 
students defined by shared characteristics: race/ethnicity, type of location, parents’ 
education level, and gender. Contextual information about reading policies, instruction, 
and home support for reading is presented for public school students. State results are 
based on the representative sample of students who participated in the 1994 Trial State 
Reading Assessment Program. Results for the region and the nation are based on the 
regional and national representative samples of students who participated in the national 
NAEP assessmen t. 

1 For a summary of the 1990 program, see Ina V.S. Mullis, John A. Dossey, Eugene H. Owen, and Gary W. Phillips. 
The State of Mathematics Achievement: NAEP's 1990 Assessment of the Nation and the Trial Assessment of the States. 
(Washington, DC: National Center for Education Statistics, 1991). 

2 For a summary of the 1992 assessment of reading, see Ina V.S. Mullis, Jay R. Campbell, and Alan E. Farstrup. The 
NAEP 1992 Reading Report Card for the Nation and the States. (Washington, DC: National Center for Education 
Statistics, 1993). For a summary of the 1992 assessment of mathematics, see Ina V.S. Mullis, John A. Dossey, Eugene 
H. Owen, and Gary W. Phillips. NAEP 1992 Mathematics Report Card for the Nation and the States. (Washington, 
DC: National Center for Education Statistics, 1993). 
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School and Student Participation in the Reading Assessment 

In Indiana, 100 public schools and 10 non-public schools participated in the 1994 
fourth-grade reading assessment. These numbers include participating substitute schools 
that were selected to replace some of the nonparticipating schools from the original 
sample. The weighted school participation rate after substitution in 1994 was 
92 percent for public schools and 85 percent for non-public schools, which means that 
the fourth-grade students in this sample were directly representative of 92 percent and 
85 percent of all the fourth-grade public and non-public school students in Indiana, 
respectively. 

In Indiana, 2,655 public school and 219 non-public school fourth-grade students 
were assessed in 1994. The weighted student participation rate was 96 percent for 
public schools and 95 percent for non-public schools. This means that the sample of 
fourth-grade students who took part in the assessment was directly representative of 
96 percent of the eligible public school student population and 95 percent of the 
eligible non-public school student population in participating schools in Indiana (that 
is, all students from the population represented by the participating schools, minus those 
students excluded from the assessment). 

The overall weighted response rate (school rate times student rate) was 89 percent 
and 81 percent for public and non-public schools, respectively. This means that the 
sample of students who participated in the assessment was directly representative of 
89 percent of the eligible fourth-grade public school population and 81 percent of the 
eligible fourth-grade non-public school population in Indiana. 

Following standard practice in survey research, the results presented in this report 
were produced using calculations which incorporate adjustments for the nonparticipating 
schools and students. Hence, the final results derived from the sample provide estimates 
of the reading proficiency and achievement for the full population of eligible public and 
non-public school fourth-grade students in Indiana. However, these nonparticipation 
adjustments may not adequately compensate for the missing sample schools and students 
in instances where nonparticipation rates are large. 

In order to guard against potential nonparticipation bias in published results, NCES 
has established minimum participation levels necessary for the publication of 1994 Trial 
State Assessment results. NCES also established additional guidelines that address four 
ways in which nonparticipation bias could be introduced into a jurisdiction’s published 
results (see Appendix A). In 1994, Indiana met all established NCES participation rate 
guidelines for both public and nonpublic schools. Hence, results for both types of 
schools are included in this report. 
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Students’ Reading Performance 

The table below shows the distribution of reading proficiency of fourth-grade 
students attending public schools in Indiana, the Central region, and the nation. 

1994, Public School Students 

The average reading proficiency of fourth-grade public school students 
in Indiana on the NAEP reading scale was 220. This average was higher 
than that of students across the nation (21 2). 3 The lowest performing 
10 percent of public school fourth graders in Indiana had proficiencies 
at or below 173 while the top 10 percent had proficiencies at or above 
263. In public schools across the nation, the lowest performing 10 
percent of fourth graders had proficiencies at or below 156; the top 
performing 10 percent of students had proficiencies at or above 261. 

1992 vs 1994, Public School Students 
There was no significant change in the average performance of 
fourth-grade public school students in Indiana from 1992 to 1994 (221 
in 1992 and 220 in 1994). During the same period, there was no 
significant change in the average performance of fourth-grade public 
school students across the nation (215 in 1992 and 212 in 1994). 
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1992 

Indiana 

Central 

Nation 

1994 

Indiana 

Central 

Nation 



Distribution of Reading Proficiency for Fourth-Grade 
Public School Students 



Average 


10th 


25th 


50th 


75th 


90th 


Proficiency 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



221 (1.3) 180 ( 2.4) 201 (1.7) 223( 12) 243(1.1) 260(1.5) . 

318 <SllS) i 172 ( 27) i. ,496 ( 24) J 221 (13) v, ' 241 { 25) : 260 (.3.7) 

' 215 { 1 .0) ^ ; 168 ( 13) ; ;19? ( 1 .0} . ; 217(1.7),,; ~240<1.3) ,.|ZSS^2.3) 4 

223 (1.4) | i.245 ( 1.8)- 1263(1.5) I 
" 218, ( ZJi, t : 166(4#). . 495 ( 39) „ . 223 {33)'i ; 245 ( 27) -964 ( 29)**« 

212 (1:1) 7 • *156 ( 2-1);< ; -187 (13)< 217,< 12) 4 -*241 ( .1.2), $ .261 (1:5)^.- 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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3 Differences reported as significant are statistically different at the 95 percent confidence level. This means that with 
95 percent confidence there is a real difference in the average reading proficiency between the two populations of 
interest. 
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Performance According to Purpose for Reading 

The 1994 Trial State Assessment Program considered students’ performance in 
situations that involved reading different kinds of materials for different purposes. The 
fourth-grade reading assessment measured two global purposes for reading — reading 
for literary experience and reading to gain information. The table below provides 
results for Indiana, the Central region, and the nation according to each reading purpose. 

1994, Public School Students 

The proficiency of public school students in Indiana in reading for 
literary experience (221) was higher than that of students across the 
nation (214). Similarly, in reading to gain information, the proficiency 
of public school students in Indiana (218) was higher than that of 
students across the nation (210). 

1992 vs 1994, Public School Students 
Indiana’s public school fourth graders showed no significant change 
from 1992 to 1994 in reading for literary experience. Similarly, in 
reading to gain information, public school fourth graders in Indiana 
exhibited no significant change from 1992 to 1994. 
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Distribution of Reading Proficiency for Fourth-Grade 
Public School Students According to Purpose for 
Reading 



1994 Trial Stale Assessment 


Average 

Proficiency 


10th 

Percentile 


25th 

Percentile 


50th 

Percentile 


75th 

Percentile 


90th 

Percentile 


Reading for Literary Experience 


zM-SMXi 








WW0 Wf 


\y 


j U ». 


1992 Public 


,/\c 1,? 


' ;f|: 




’ i 




WBWW:Wi 


, 


Indiana 


224(13) 


182(2.1) 


204 ( li)^ 


225 


(1-3) 


246(1.4) 


.263 (-1:6)#; 


Central 








221 


(2*6) 




262 ( 3.3) 


Nation 


- 


169 ( 1.7) 




.219 


(1-1) 


242(1 -3) 262 ( 1.6) 


1994 Public 


i ■ V ; . 




' ' - S;- J.;;:: 








'0' '' ' ji| 


Indiana 




172 { 2.7) < 


198(2.0) 


224 




247 ( 1.6) 


266 -( 2.6) l 


Central 


{221(2.8) 




fiify'i 4.0) , 


225 


(2.5) 


249 ( 2.3) , 




Nation 


214(12) 


157|22)< 


189 ( 1.6) ; 


S# 


wmM 






Reading to Gain Information 




• -f t- :: § 












1992 Public 


/T f 




1- X33PX.2 






CSi'* 1 W ^0- w 




Indiana 


218(1.4) 




19#t|ff 


Si 9 


(1.5) 


T2A0i . 


259 ( 1.9) i 


Central 


limits 






219 






260 ( 2.5) 


Nation 




t62 


187(1.4) 


w& 




238 ( 1.3) ; 


•2S9f1$)H 


1994 Public 


' v c f -*{;> 0 














Indiana 




168(3.2) t! 


194 ( 1.8 ) 


f w 








Central 




-160 


1 1911 3.3) 




wm 






Nation 


aio 








( 1-5) 




■2f^cmkA 



The NAEP “purpose for reading” scales range from 0 to 500. The standard errors of the statistics appear in parentheses. 
It can be said with about 95 percent confidence that, for each population of interest, the value for the entire population 
is within ± 2 standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error 
of the difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school 
students in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. 
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Levels of Reading Achievement 

The most recent reauthorization of the National Assessment Governing Board 
(NAGB) continues the Board’s responsibilities to set policy for NAEP and to “develop 
appropriate student achievement levels for each age and grade in subject areas tested” 
(Pub. L. 103-382). 

NAGB developed three achievement levels for each grade — Basic, Proficient, 
and Advanced. Performance at the Basic level denotes partial mastery of the knowledge 
and skills that are fundamental for proficient work at each grade level. The central level, 
called Proficient, represents solid academic performance at each grade level tested. 
Students reaching this level demonstrate competency over challenging subject matter and 
are well prepared for the next level of schooling. Performance at the Advanced level 
signifies superior performance at the grade tested. Definitions of the three levels of 
reading achievement are given below. Chapter 3 provides further elaboration of these 
levels and presents examples of types of questions that students at each of the three 
achievement levels can respond to effectively. 
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Description of Fourth-Grade Reading Achievement 
Levels 



Achievement 

Level 


Scale 

Outpoint 


Description 


1 INtN|N % 

ADVANCED 

: ^ v : • J*; 


268 


Fourth-grade students performing at the Advanced level 
should be able to generalize about topics in the reading 
selection and demonstrate an awareness of how authors 
compose and use literary devices. When reading text 
appropriate to fourth grade, they should be able to judge 
texts critically and, in general, give thorough answers that 
indicate careful thought. 


i?;:| r £^4- • F 4 4 

• ■ £ "’> 2- 

. 4 .; j C& 4 

PROFICiENT 

' 4 f : < v .: v i j' -f if: :* • • •:« ' ^ 

4 X * .<* •> '•:' '' if •" : 

? (4 f : 

S }. ■&&■'•*■■■$■ ■:i-TVN * 

; . ^ 'J ' 

*£>• / x- jf •: " Tf : V jt ■ ’ : " 4 4*:^ 


238 


Fourth-grade students performing at the Proficient level 
should be able to demonstrate an overall understanding 
of the text, providing inferential as well as literal 
information. When reading text appropriate to fourth grade, 
they should be able to extend the ideas in the text by 
making inferences, drawing conclusions, and making 
connections to their own experiences. The connection 
between the text and what the student infers should be 
clear. 


-i • if - : • j - X 

if BASIC : »' 

'V ! V 4 >• 

if '/:'4 ■ ; - 


208 


Fourth-grade students performing at the Basic level should 
demonstrate an understanding of the overall meaning of 
what they read. When reading texts appropriate for fourth 
graders, they should be able to make relatively obvious 
connections between the text and their own experiences. 
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The table below provides the percentage of fourth-grade students at or above each 
achievement level, as well as the percentage of students below the Basic level. 

1994, Public School Students 

The percentage of public school students in Indiana who were at or 
above the Proficient level (33 percent) was higher than that of students 
across the nation (28 percent). 

1992 vs 1994, Public School Students 
From 1992 to 1994, there was no significant change in the percentage 
of public school students in Indiana who attained the Proficient level 
(30 percent in 1992 and 33 percent in 1994). Similarly, there was no 
significant change in the percentage of public school students across the 
nation who attained the Proficient level (27 percent in 1992 and 
28 percent in 1994). 
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Levels of Fourth-Grade Public School Students’ 
Reading Achievement 



Ml 


At or Above 
Advanced 


At or Above 
Proficient 


At or Above 
Basic 


Below 

Basic 




1994 Trial State Assessment 


1992 Public 
Indiana 
Central 
Nation 
1994 Public 
Indiana 
Central 
Nation 


Percentage. ’ . 

6 ( 0.9) 30 ( 1 .5) 68 ( 1.6) 32( 1.6) . 

6 ( 0.6) 27 (1.3) 60(1.1) 40(1.1) 

7(0.8) 33(1.5) : |||||pj 35 ( 3 0) 



The standard errors of the statistics appear in parentheses. It can be said with about 95 percent confidence that, for each 
population of interest, the value for the entire population is within ± 2 standard errors of the estimate for the sample. In 
comparing two estimates, one must use the standard error of the difference (see Appendix A for details). If the notation 
> (<) appears, it signifies that the value for public school students in 1994 was significantly higher (lower) than the value 
for 1992 at about the 95 percent confidence level. 



Subpopulation Performance 

Assessment results repeatedly show differences in performance for subpopulations 
of students. 4 The 1994 Trial State Assessment provides additional information about 
the performance of important subpopulations by reporting on the reading proficiencies 
of various subgroups of the public school student population defined by race/ethnicity, 
type of location, parents’ education level, and gender. These results are summarized in 
the table on page 8. 
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Race/Ethnicity 

1994 , Public School Students. The average reading proficiency of White 
students in Indiana public schools was higher than that of Black and 
Hispanic students. 

1992 vs 1994, Public School Students . There was no significant change 
in the average reading proficiency of White, Black, or Hispanic public 
school students in Indiana from 1992 to 1994. 

Type of Location 

1994 , Public School Students. The average reading proficiency of 
Indiana students attending public schools in central cities was lower than 
that of students in urban fringe/large towns and rural areas/small towns. 

1992 vs 1994 , Public School Students. From 1992 to 1994, there was 
no significant change in the average reading proficiency of students 
attending public schools in central cities, urban fringe/large towns, or 
rural areas/small towns in Indiana. 

Parents 9 Education Level 

1994 , Public School Students. Public school students in Indiana 
reporting that at least one parent graduated from college demonstrated 
an average reading proficiency which did not differ significantly from 
that of students who reported that at least one parent had some education 
after high school but was higher than that of students who reported that 
at least one parent graduated from high school, neither parent graduated 
from high school, or they did not know their parents’ education level. 

7992 vs 1994 , Public School Students. Public school students in Indiana 
who reported that they did not know their parents’ education level had 
a lower average reading proficiency in 1994 than in 1992. The average 
proficiency of public school students in Indiana who reported that at 
least one parent graduated from college, at least one parent had some 
education after high school, at least one parent graduated from high 
school, or neither parent graduated from high school did not change 
significantly between 1992 and 1994. 

Gender 

1994, Public School Students. In public schools in Indiana, girls 
exhibited an average reading proficiency which was higher than that of 
boys. 

7992 vs 1994, Public School Students. In Indiana public schools, the 
average reading proficiency for boys did not change significantly from 
1992 to 1994. Similarly, the average proficiency for girls did not change 
significantly from 1992 to 1994. 
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Fourth-Grade Public School Students’ Average 
Reading Proficiency by Subpopulation 



1994 Trial State Assessment 



1992 


1994 


Profic 


iency 



RACE/ETHNICITY 

White Indiana 

Central 
Nation 

Black Indiana 

Central 
Nation 

Hispanic Indiana 

Central 
Nation 

TYPE OF LOCATION * 

Central City Indiana 

Nation 

Urb Fringe/Lrg Town Indiana 
Nation 

Rural/Small Town Indiana 
Nation 

PARENTS’ EDUCATION 

Indiana 
Central 
Nation 
Indiana 
Central 
Nation 
Indiana 
Central 
Nation 
Indiana 
Central 
Nation 
Indiana 
Central 
Nation 

Indiana 
Central 
Nation 
Indiana 
Central 
Nation 



College graduate 



Some educ after HS 



HS graduate 



HS non-graduate 



I don’t know 



GENDER 

Male 



Female 
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Iff! 



ilillf 



/:■ : -;4; 
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221 ( 2.4) 

I Ef 

^ -"if 

197 (V.7) 

216 < -1.6) 

:;:9na / i <?\ 



£21 3.$(< 2jT)*«#3;C . 

209( 1.3) 

wnBHnlf -*■'• " 



baaim^Sl 
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' ;;l223<{ T;3)’ 4'-rf- 
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226 ( 3.0) ■ ,': 
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* School sample size is insufficient to permit reliable regional results for type of location. 

The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). If the notation > (<) appears, it signifies that the value for public school students 
in 1994 was significantly higher (lower) than the value for 1992 at about the 95 percent confidence level. *** Sample 
size is insufficient to permit a reliable estimate. 
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Reading Performance of Non-Public School Students 

The 1994 Trial State Assessment marks the first time that non-public school 
students were assessed at the state level. Therefore, separate non-public school results 
can be reported for Indiana. Also, results based on a combined sample of public and 
non-public school students can be presented. The following table shows the distribution 
of overall reading proficiency for the non-public school and combined populations. The 
corresponding public school student results can be found in the table on page 3. 

Non-Public School Students 

The average reading proficiency of fourth-grade students in non-public 
schools in Indiana was 234. This average was not significantly different 
from that of non-public school students across the nation (231). 

Public and Non-Public School Student Comparison 
The average reading proficiency of fourth-grade students in non-public 
schools in Indiana was higher than the average for public school students 
(234 for non-public and 220 for public). For the nation, the average 
reading proficiency for non-public school students was higher than that 
of their public school counterparts (231 for non-public and 212 for 
public). 

1994, Public and Non-Public School Students Combined 
The average reading proficiency of grade 4 students from Indiana was 
221. This average was higher than that of students across the nation 
(214). The lowest performing 10 percent of fourth graders from Indiana 
had proficiencies at or below 174 while the top 10 percent had 
proficiencies at or above 264. The lowest performing 10 percent of 
students across the nation had proficiencies at or below 159 while the 
top 10 percent had proficiencies at or above 263. 



THE NATION’S 

report ircaer, 

CARD ~ 



1994 Trial State Assessment 
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Hi 



1994 Non-Public 
Indiana 
Central 
Nation 

1994 Combined 
Indiana 
Central 
Nation 



Distribution of Reading Proficiency for Fourth-Grade 
Students, Non-Public and Combined Schools 



Average 


10th 


25th 


50th 


75th 


90th 


Proficiency 


Percentile 


Percentile 


Percentile 


Percentile 


Percentile 



& ' • -5T $' ^ ?' **. 

-234 ^ 4 .# * 195 ( 5 . 6 ) • 

230 ( 3 . 0 ) 

.231{ 2J5} ^ 188 C42) 

221 (1.3) | 1 174(2.3) 
220 ( 2*4} £ v 1 69 { 4C3) 
214C%0> 159(1.6) 



214 (6;8) 
210 { 23) 
;l211J23) ; 

199 (1.5) 
197(2.8) 
189(12) 



236 { 52) .,.,254. ( 5.4) l 271 1( 5.1) . 

233 ( J 251, ( 4.6) i * ■ 268 ( 4.3) 
233(2.3).: £ ,,254 ( 1.9) * . 272 (2.7) 



224(1.4): 

224(l^jr; 

219 (1.1): 



246( iM) 
246 { 1.9) : 
243 ( It) 



264(12) 
264 ( 2.7) 
263(15) 



The NAEP reading scale ranges from 0 to 500. The standard errors of the statistics appear in parentheses. It can be said 
with about 95 percent confidence that, for each population of interest, the value for the entire population is within ± 2 
standard errors of the estimate for the sample. In comparing two estimates, one must use the standard error of the 
difference (see Appendix A for details). 
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A Context for Understanding Students’ Reading Proficiency in Public Schools 

Information on the reading performance of students in Indiana can be better 
understood and used for improving instruction and setting policy when supplemented 
with contextual information about schools, teachers, and students. 

To gather contextual information, the fourth-grade students participating in the 
1994 Trial State Assessment, their reading teachers, and the principals or other 
administrators in their schools were asked to complete questionnaires on policies, 
instruction, and programs. The student, teacher, and school data help to describe some 
of the current practices and emphases in reading education, illuminate some of the 
factors that appear to be related to fourth-grade public-school students’ reading 
proficiency, and provide an educational context for understanding information on student 
achievement. Highlights of the results for the public-school students in Indiana are as 
follows: 

CURRICULUM COVERAGE AND INSTRUCTIONAL EMPHASIS 

• In Indiana in 1994, average reading proficiency was lowest for students 
whose teachers spent 90 minutes or more on reading instruction each 
day. 

• According to the public school administrators in Indiana, in 1994, 

73 percent of the fourth-grade students were in schools where reading 
was identified as receiving special emphasis. This percentage was 
smaller than that of students across the country (85 percent). 

• In 1994, according to their reading teachers, 24 percent of the students 
in public schools in Indiana were typically taught reading in a class that 
was grouped by reading ability. The prevalence of ability grouping was 
not significantly different across the nation (22 percent). 



DELIVERY OF READING INSTRUCTION 

• Students in Indiana whose teachers used both basal and trade books 
demonstrated an average reading proficiency (223) which was higher 
than that of students whose teachers primarily used basal readers (216). 

• The proficiency of Indiana students whose teachers used both basal and 
trade books (223) was not significantly different from that of students 
whose teachers primarily used trade books (223). 

• The proficiency of Indiana students whose teachers primarily used trade 
books (223) was not significantly different from* that of students whose 
teachers primarily used basal readers (216). 
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* Although the difference may appear large, recall that “significance” here refers to “statistical significance.” (See 
Appendix A for further discussion.) 



10 



THE 1994 NAEP TRIAL STATE ASSESSMENT 



Indiana 



• In Indiana, 27 percent of the fourth-grade students had reading teachers 
who used children’s newspapers and/or magazines at least once a week; 
16 percent of the students had reading teachers who used reading kits 
at least once a week; 27 percent had reading teachers who used 
computer software for reading instruction at least once a week; 
61 percent of the students had reading teachers who used a variety of 
books at least once a week; and, finally, 59 percent of the students had 
reading teachers who used materials from other subject areas at least 
once a week. 

• According to the Indiana reading teachers, 56 percent of the students 
were asked to discuss new or difficult vocabulary almost every day. 
This percentage did not differ significantly from that of students across 
the nation (62 percent). 

• According to their reading teachers, the percentage of students in Indiana 
who were asked to talk with each other almost every day about what 
they have read (23 percent) was smaller than that of students across the 
nation, where 34 percent of the students were asked to do this activity 
almost every day. 

• According to the reading teachers in Indiana, 2 percent of the students 
were asked to do a group activity or project about what they have read 
almost every day. This figure was smaller than that of students across 
the nation (5 percent). 



EDUCATIONAL BACKGROUND OF TEACHERS 

• The percentage of students who were being taught by reading teachers 
who reported having at least a master’s or education specialist’s degree 
in Indiana (84 percent) was greater than that for the nation (41 percent). 

• A large majority of the students (86 percent) had reading teachers who 
had the highest level of teaching certification that is recognized by 
Indiana. This was greater than the figure for the nation, where 
65 percent of the students were taught by reading teachers who were 
certified at the highest level available in their states. 

• In Indiana, 16 percent of the students were being taught reading by 
teachers who had an undergraduate major in English, reading, and/or 
language arts. This was not significantly different from the percentage 
of students across the nation who were being taught by reading teachers 
with the same major (20 percent). 
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HOME FACTORS 

• In Indiana, 38 percent of the students reported having four types of 
reading materials (a newspaper, an encyclopedia, 25 or more books, and 
magazines) in the home. This figure was not significantly different from 
that for the nation (36 percent). Students in Indiana who had all four 
of these types of materials in the home showed an average reading 
proficiency (229) which was higher than that of students with zero to 
two types of materials (206). 

• In 1994 in Indiana, 26 percent of the students discussed with friends or 
family what they read almost every day. This percentage did not differ 
significantly from that of students across the nation (28 percent). The 
proficiency of students in Indiana who discussed what they read with 
friends or family almost every day (218) did not differ significantly from 
that of students who had discussions with friends or family less than 
weekly (216). 

• Less than one fifth of the fourth-grade students (18 percent) watched 
six hours or more of television each day. This was smaller than the 
figure for the nation, where 22 percent of the students watched this 
much television. Average reading proficiency in Indiana was lowest for 
students who spent six hours or more watching television each day. 

Comparisons of Overall Reading Proficiency in Indiana with Other States 

The map on the following page provides a method for making appropriate 
comparisons of the overall public school reading proficiency in Indiana with that in other 
states (including Guam and the Department of Defense Education Activity [DoDEA] 
Overseas Schools) that participated in the NAEP 1994 Trial State Assessment Program. 
The different shadings of the states on the map show whether the average overall 
proficiency of public school students in the other states was statistically different from 
or not statistically different from that of public school students in Indiana (‘Target 
State”). States in black have a significantly lower average public school proficiency than 
does Indiana. States with a dark-gray shading have a significantly higher average public 
school proficiency than does Indiana. States with a light-gray shading have an average 
public school proficiency that does not differ significantly from that of Indiana. The 
significance tests are based on a Bonferroni procedure for multiple comparisons that 
holds the probability of erroneously declaring the means of any two states to be different, 
when they are not, to no more than five percent. Two states — Idaho and Michigan 
— did not meet minimum school participation guidelines for public schools. Another 
jurisdiction — Washington, DC — withdrew from the Trial State Assessment after the 
data collection phase. Therefore, these three jurisdictions are not included in the 
comparisons depicted on the map on the following page. 
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The 1994 Trial State Assessment 

Comparisons of Overall Reading Proficiency 
Grade 4 Public Schools 

Indiana 
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